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ASSESSMENT MODEL 


In the model, educational assessment is defined as the process of 


delineating information needs, planning for data collection, obtaining 


information, and providing information for decision making. Figure 1 shows 


the four.phases of the model - delineating, planning, obtaining, and 


providing .- and specific tasks within each phase. 
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Once the decision to.evaluate individualized instructional approaches in 


Occupational Education at the Technical Institute/Community College level has ’ 


been made, =the procedures specified in:the model could be used to provide 


UA 
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information. and feedback for decision making. A description of each phase of 
the model with suggestions. for implementation follows. The examples included 


are for purposes of clarification of various aspects of the model. 
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GUIDELINES FOR IMPLEMENTING 
THE ASSESSMENT MODEL 
Phase 1. Delineation of Information Needs 


The specific tasks involved in Phase 1 are shown in Figure 2. 


1.1. Set Boundaries. Establish boundaries or limits within which the assessment 
plan is to be implemented. Boundaries in a particular situation would include 
the educational areas to be assessed and should be limited to a manageable size 
and to’ factors of particular interest in an institution. 


EXAMPLE: Courses tn Occupational Education classified as using an 
indtvtdualtzed tnstructional approach. 


1.2..Specify Decisions. Specify decisions to be considered including the 
reason for assessment, personnel, budget limitations, time schedule, and 
questions to be answered by the assessment procedure. 

1.21. Define reason for assessment. Identify and define reasons for 
assessment. This may include such factors as difficulties encountered in the 
program, community pressures, accountability, requests for data from the State 
Department of Public Education, or a lack of data relevant to the effective- 
ness of individualized instructional approaches. 

EXAMPLE: Conttnuatton of Federal funding requires assessment. 

1.22. Decide on personnel to conduct assessment. Identify the two 
groups -of -individuals who are to be involved in the assessment procedure - the 
decision makers and members of the assessment team. Throughout the guidelines 
the decision maker is the individual(s) responsible for making final decisions 


on the basis of data provided by the assessment team. 


Figure 2 


TASKS FOR:DELINEATION OF INFORMATION NEEDS 
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Lei “se Lee LZ 1.24 1.25 


Institution Program Rationale - Faculty Facilities, Advisory 
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a Peal Lose tos 35 1.36 1.37 
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EXAMPLE: A committee composed of the Educational Development 
Officer, the Dean of Instruction, and selected faculty 
members may be the deciston makers in a particular 
sttuatton. 
The second group of individuals to be identified is the assessment team. 
The major task of this team is to provide information to assist the decision 
maker(s) is making a choice between decision alternatives. It is recommended 
that members of the assessment team be selected from both inside and outside 
the institution. Some questions to be answered concerning selection of team 
members are: 
Who should select the team members? 


How many members should be included? 


What groups of individuals from outside the institution should be 
represented on the team? 


What groups of individuals from within the institution should be 
represented on the team? 


EXAMPLE: An assessment team may include one faculty member from 
each oceupattonal area represented at the instttutton; 
the Director of Occupattonal Education; the Dean of 
Instructton; the Educattonal Development Officer; a 
eonsultant from a Teacher Education Institution; and a 
consultant from the State Department of Publie Education. 
Some consideration must be given to personnel available for data analysis. 
If computer facilities are available, then someone with a background in use of 
the computer should serve as a consultant. Whether or not computer facilities 
are available, a qualified person should be selected to assist with the data 
analysis. 
1.23. Set budget limitations. State the amount of support for the 
assessment procedure and the sources of funds or resources available. Since 


the scope of the assessment is often determined by budget limitations, it may 


be necessary to assign priorities in order to direct the assessment procedure. 


1.24. 


[pe 


Plan time schedule. Establish a time schedule for the entire 


assessment procedure. This schedule should be planned in advance to assure 


adequate time 


for the completion of each phase of the assessment. Information 


reported after decisions have been made is of little value. 


EXAMPLE: 
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List specific 
EXAMPLES: 


1, Doe 


See Figure 3. 


Identify questions to be answered by the assessment procedure. 


questions to be answered by the assessment procedure. 


% of the students in each course reach the objectives at the 


level specified? 


2. What 


are the characteristics of the students who failed to reach 


the objectives? 


3. Are the facilities adequate for the achievement of the objectives? 


4. Is the expenditure of funds adequate for achieving the objectives? 


5. Do faculty members incorporate as many aspects of individualized 
instruction as feasible in this setting? 


6. How effective is the instruction provided by the faculty members 
as viewed by the students? 


7. Do students indicate that course content as well as their total 
program is relevant and meeting their needs? 


8. Do employment opportunities in the region serve as a basis for 
program planning and development? 


9. Do students have a positive attitude toward the individualized 
courses? 


10. Does 


the faculty have a positive attitude toward individualized 


instructional approaches? 


11. Are students adequately prepared for employment? 


12. What feedback have administrators received from various groups? 


13. To what extent have expenditures for faculty, facilities, and/or 
materials changed with the use of individualized instructional 
approaches? 


ASSESSMENT PHASES 


1. 


Bis 


DELINEATE INFORMATION 
NEEDS 


1.1. Set Boundaries 


Sept. Oct. 


=a 


1.2. Specify Decisions 4 


1.3. Identify Background 
Information Needs 


PLAN FOR DATA COLLECTION 
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14. How effective are the instructional materials? 
15. Can expenditure of funds be justified by benefits received? 


1.3 Identify Background Information Needs. Provide background information 


for the assessment procedure as follows: 

1.31. Institutional goals and/or objectives. Obtain institutional 
goals and/or objectives. These objectives should clearly communicate the 
intent of the educational institution to the assessment team. 


EXAMPLE: To provide opportunity for the development of skills 
necessary to enter an occupattonal field. 


1.32. Program goals. Identify program goals. They should be stated 
so that the intent of the program(s) to be evaluated is communicated to the 
assessment team. 

EXAMPLE: To enable both male and female students to perform basic 


skills as a health asststant that will prepare them for 
employment. 


1.33. Rationale for decision to implement individualized instructional 
approach. Obtain reasons for implementing individualized instruction in the 
courses or programs to be assessed. 

EXAMPLE: Use of tndividualized instructional approaches may increase 


the degree to whitch educattonal needs of the tndivitdual 
student can be met. 


1.34. Characteristics of the student body. List variables to be 
considered in the assessment procedure including such characteristics as: 
age, school status, sex, marital status, achievement, and major area of study. 
1.35. Characteristics of the faculty. Include demographic data 
describing the faculty such as educational background, work experience, number 
of years using individualized instructional approaches, type and amount of 
training in the use of individualized instructional approaches, sex, and 


number of years teaching experience. 
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1.36. Description of facilities, equipment, and materials. Describe 
the facilities, equipment, and materials available for use with the program. 
Facilities include the space, special equipment, and expendables needed for 
using individualized instructional approaches in the educational program(s). 
1.37. Background information about advisory council members. Include 
such demographic data for the advisory council members as occupation, position, 
educational level, number of years in the occupation, sex, and number of years 


serving on the council. 
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Phase 2. PLAN FOR DATA COLLECTION 


Tasks included in this phase are shown in Figure 4. As decisions are 
made for task 2.1, 2.2, 2.3, and 2.4, record them on a planning sheet similar 
to the one in Figure 5, 

2.1 Determine Types of Information. Identify specifically the information 


needed to answer questions previously developed for task 1.25. 


EXAMPLES: Questtons from 1.25 Types of Information 


i Achtevement 
6 Reactions to Course and Instructor 
9 Attitude Toward Individualtzed 
Instructton 
i2 Employee Tratts 
14 Assessment of Individualtzed 


Instructional Materials 
2.2 Identify Sources of Information. Identify groups of individuals from 


whom the different types of information can be obtained. 


EXAMPLES: Sources Types 
Student Achtevement 
Faculty Assessment of Indtvtdualized 
Instruettonal Matertals 
Administrators Attitude Toward Indivtdualtzed 
Instruction 
Employers Employee Tratts 


2.3 Select Appropriate Data Collection Devices. Select appropriate data 


collection devices for answering the assessment questions developed in task 
1.25 and further clarified in tasks 2.1 and 2.2. Data collection devices are 
in packet A. A cover sheet relating source of information, type of informa- 
tion, and assessment devices is included with the packet. Specific 
instructions for use are provided with each instrument. If additional types 
of information are desired, the instruments for data collection must be 


developed or obtained. 


Figure 4 


TASKS FOR PLAN FOR- DATA COLLECTION 
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EXAMPLES: Question 1 - Do 90 per cent of the students in the course 
achieve at a 90 per cent level on all of the 
objectives? 


Data Collection Device - Achtevement Test. 


Question 10 - Does the faculty have a positive attitude 
toward individualized instructtonal approaches? 


Data Collection Device - Individualized Instruction Attttude 
Seale. 


2.4 State Minimum Criteria Levels. Establish the minimum score or criteria 
for each assessment measure prior to the collection of data. The statement 
of these criteria is dependent upon the assessment questions previously 
developed in task 1.25. 
EXAMPLE: 7. Assessment Procedure - Achievement Test 
Minimum Criteria Level - Ninety per cent of the students 
should achieve test scores of 
ninety per cent for all the 
objectives. 
2. Assessment Procedure - Individualized Instructton Inventory 
Minimum Criteria Level - Establish aeceptable scores for 
each factor on the tnventory. If 
a '3', implying that the practice 
oceurs at least half the time, ts 
satisfactory, then an acceptable 
score for Factor I, Self Evaluation, 


whteh tneluded three items, is nine 
or above. 


IT: MUST: BE.REMEMBERED THAT THESE ARE .EXAMPLES, AND CRITERIA SHOULD BE ESTABLISHED 
TO FIT EACH ASSESSMENT SITUATION! 


2.5 Determine Sampling Procedure. Determine the procedure to be used for 
selecting participants in the assessment procedure. If the number of persons 
within the groups providing information is not too large, all may be included. 
However, if the number is too large, a sample may be drawn. A sample or 
samples may be chosen by any random sampling method. 


EXAMPLE: Select a simple random sample using a table of random numbers. 
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Phase 3. OBTAIN INFORMATION 


Tasks included in this phase are shown in Figure 6. 


Figure 6 


TASKS FOR OBTAINING INFORMATION 
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Bis 


Collect Data Organize and Analyze Data 
Sal Sez 


Code Tabulate Summarize Interpret 
Data Data Data Data 
eye Pak B22 S525 Bee 


3.1 Collect Data. Develop a schedule for data collection based on the tasks 
completed in phase 2. Include the following items in the schedule: source of 
information, sample size, data collection devices, person responsible for 
seeing that these data are collected, time or schedule for completing data 
collection, and date actually completed. 


EXAMPLE: See Figure 7. 


Source of 


Information 


EXAMPLE: 


Faculty 


Sample 
Size 


Figure 7 


DATA COLLECTION 
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Checklist - Individualized 
Instruction Inventory 
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Completed 


February 10, 1975 
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3.2 Organize and Analyze Data. Code, tabulate, summarize, and interpret data. 

3.21. Code data. Tasks at this stage depend upon whether or not 
computer services are available. Regardless of the procedure to be used, the 
consultant referred to in phase 1 will be responsible for assisting with these 
tasks. 

3.22. Tabulate data. Refer to task 3.21. 

3.23. Summarize data. Summarize data on the basis of information 
needed to provide answers to the questions developed in phase 1. Refer to 
"Suggestions for Criteria Levels and Summarization of Data" within Appendix.E. 


EXAMPLE: Compute or record the number of students who. have reached 
the level of performance previously establtshed. 


3.24. Interpret data. Summarize the data obtained in relation to 
the questions developed in task 1.25. Criteria that were previously established 
in 2.4 are now applied to the available evidence to determine whether or not 


these criteria have been met. 
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Phase 4. PROVIDE INFORMATION FOR 
DECISION MAKING 


Tasks to be performed within this task area appear in Figure 8. 


Figure 8 


TASKS FOR PROVIDING INFORMATION 
FOR DECISION MAKING 
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Line 


Select Options 
ak 


Prepare Report 
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Outline Assign Prepare 


Information ‘Report Dissemination 
Preparation Plan 
4.11 4.12 4.13 


4.1 Prepare Report. Outline information to be included in the report, 
identify personnel to complete the report, and develop a plan for dissemina- 
tion of the report. 

4,11. Outline information to be included in the report. Present 
information according to the four phases of the model or dab! the technical 
research paper format which includes an introduction, procedures, findings, 


summary, and implications. 
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4.12. Assign preparation of report to selected personnel. Select 
personnel to prepare the report in a suitable form for dissemination to the 
different audiences. Included in this task is the identification of needed 
clerical and printing assistance. 

4.13. Prepare plan for dissemination of report. Identify audiences 
to receive the report and methods to be used in transmitting the report. 
Answers to the following questions must be determined. 

1. To which individuals or groups will the report be given? 


2. In what order will the report be received by those individuals and/or 
groups? Who should be the first to receive the findings? 


3. What method of presentation will be most effective, considering the 
composition of the audience? 


4. What methods of dissemination will the reporting follow? 


EXAMPLE: Order in whtch the report would be released to the following 
audiences: 


Dean of Instruction 
Staff Development personnel 
Faculty committee 
Faculty members involved in the study 
Advisory Board and/or Employers in the community 
EXAMPLE: Method of dissemination 
Seminars 
Workshops 
Placement of complete coptes in library, media center, 
faculty work centers 
4.2 Make Decisions. Select the best decision options. 
4.21. Select options. The decision maker(s) control(s) the decision 
to be made based on the data. Possible options are to maintain, modify, 


expand, contract, or terminate the individualized instructional approach being 


assessed. Background information collected in the first phase of the 
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assessment procedure must be considered as results of the data collected in 


phase three are examined. 


EXAMPLE: 


If the criterion was established that ninety per cent of the 
students should achieve ninety per cent on all of the objec- 
tives and achievement test scores indicated that this had 
occurred, then the dectston option to matntain the use of 
individualized instruction in the program could be selected. 
However, tf the data obtatned indicated that this ertterion 
had not been met, then a different option would be recommended. 


Ts 


Il. 


IV. 


5 
DATA COLLECTION 
Format for Collection of Data 
Data Collection Devices 
A. Student Assessement Devices 
1. Reactions to Course, Instructor, and Instructional Materials 
2. Illinois Course Evaluation 
3. Individualized Instruction Attitude Scale 
B. Faculty Assessment Devices 
1. Individualized Instruction Inventory 
2. Individualized Instruction Attitude Scale 
3. Assessment of Individualized Instructional Materials 
C. Administrator Assessment Devices 
1. Individualized Instruction Attitude Scale 
2. Cost-Benefit Analysis 
D. Employer Assessment Devices 
1. Employee Performance 
2. Employment Checklist 
3. Assessment of Employee Traits 
4. Minnesota Satisfactoriness Scales 
Data Summarization Forms 
1. Profile for Individualized Instruction Attitude Scale 
2. Profile for Individualized Instruction Inventory 


Suggestions for Criteria Levels and Summarization of Data 


Administrators 


Employers 


I. FORMAT FOR COLLECTION OF DATA 


SOURCE OF INFORMATION TYPES OF INFORMATION ASSESSMENT DEVICE 


aS 
pe 


Achievement 


Course, Instructor and Instructional 
Materials Assessment 


Attitude toward Individualized 
Instruction 


Use of Individualized Instructional 
Approaches 


Attitude Toward Individualized 
Instruction 


Assessment of Instructional Materials 


Attitude Toward Individualized 
Instruction 


Analysis of Cost per Student 
Performance of Employee on the Job 
Employment Status of Employee 
Employee Traits 


Satisfactoriness of Employee 


Achievement Test 


Reactions to Course, Instructor, and 
Instructional Materials 


Illinois Course Evaluation 


Individualized Instruction Attitude 
Scale 


Individualized Instruction Inventory 


Individualized Instruction Attitude 
Scale 


Assessment of Individualized 
Instructional Materials 


Individualized Instruction Attitude 
Scale 


Cost-Benefit Analysis 
Employee Performance 
Employment Checklist 
Assessment of Employee Traits 


Minnesota Satisfactoriness Scale 


9TT 
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DATA COLLECTION DEVICES 
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STUDENT ASSESSMENT DEVICES 
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REACTIONS TO COURSE, INSTRUCTOR, AND INSTRUCTIONAL MATERIALS 
Course Title , Date 


DIRECTIONS: Describe your status as a student by checking the appropriate 


response. 

1. 2 ama: a. Female, under 25 b. Male, under 25 
c. Female, 25 or over d. Male, 25 or over 

2. Iama Full-time student : Part-time student 


3. I have attended this school: 1 - 3 quarters 
4 - 6 quarters 
7 or more quarters 


4, Expected grade for this course: 


A C Other (Specify) 
B Dion: 
5. I had sufficient preparation to enroll in this course. Yes No. 


Part I. DIRECTIONS FOR INSTRUCTOR ASSESSMENT: The following statements 
describe instructor attributes. Circle the number which best 
represents your rating as to whether the statement is: 


1. Not Descriptive (ND) 

2. Somewhat Descriptive (SD) 
3. Undecided (U) 

4. Descriptive (D) 

5. Highly Descriptive (HD) 


Instructor Attributes ND SD UL DED 


The Instructor: 
1. Knows the subject matter. Le Aw 


2. Is willing to work with students other than during 


scheduled class time. 1° 2) 824 
3. Accepts constructive criticism. Le) 3) aS 
4. Grades fairly. Bop aya DS 
5. Is aware of students needs, abilities, and interests. HS ele PO aed oe 1 


Establishes a classroom and/or laboratory situation 
Conductive to learning. 1 2 38 3S 


7. Makes me think. 15, (23 35-4) 5 
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Instructor Attributes (Continued 


8. 


9. 


LOR 


DIRECTIONS FOR COURSE ASSESSMENT: 


Respects students. 
Has a sense of humor. 


Comments 


ND SD UD’ CED 


Ta Sr pen 


2g 


Read each statement or phrase carefully and 


decide how well it describes the course. Please rate each statement 


or phrase by circling the numbers as follows: 


1. Not Descriptive (ND) 

2. Somewhat Descriptive (SD) 
3. Undecided (U) 

4. Descriptive (D) 

5. Highly Descriptive (HD) 


Overall Course Assessment 


1. 


26 


Hhil 


Content was neither too difficult nor too easy. 
I was unsure of what I was supposed to be learning. 


Objectives for each set of learning experiences or 
assignments were clearly stated and discussed. 


Learning experiences and assignments were helpful in 
reaching objectives. 


At the end of the course I was still faced with many 
unanswered questions about the material covered. 


Tests, exams, and/or other evaluation techniques were 
fair assessments of what was taught. 


Evaluation occurred frequently throughout the course. 


I would recommend that changes be made in the course 
before using it with other students. 


Evaluation materials helped me to identify my strengths 


and weaknesses. 


A variety of materials and learning experiences were 
available for student selection. 


After completing the course, I was more interested in 
and/or favorably impressed with the general subject 
matter than I was before taking the course. 
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Overall Course Assessment (Continued) ND SD UD BD 
The course: 


12. was designed to adequately develop skills and competencies. 1 2 3 4 5 


13. covered the material stated in the course description. A Ae as ae Mi 
14. was well organized. PAZ. 6B8y G05 
15. directly contributed to preparation for employment. E23 aT 
16. would be one I would recommend to others. Be 2 3) aa nae 
17. was worthwhile. Lee 3 ae S 


18. Comments 


DIRECTIONS FOR ASSESSMENT OF INSTRUCTIONAL MATERIALS: Please be honest in 
answering the following questions concerning instructional materials 
used in this course. Your assessment will be helpful in determining 
whether or not revisions are needed. Circle the number which best 
represents your rating of instructional materials according to the 
following key: 


1. Not Descriptive (ND) 

2. Somewhat Descriptive (SD) 
3. Undecided (U) 

4. Descriptive (D) 

5. Highly Descriptive (HD) 


Instructional Materials NDUSDU WU: 2D) ED 


The instructional materials: 
1. were well organized. The concepts were highly related to 


each other. eee Oa 1D 
2. were redundant. I was bored by the repetition of ideas. US oan, 
3. contained irrelevant information. 1 ae a 


4. were designed so that I could easily follow the instruc- 


tions and complete the activities. 2 2 & S 
5. contained many unfamiliar words. I often did not 

understand what was going on. $269 8 3 
6. 


included pre-test and post-test questions which 
adequately tested my knowledge of the main points of 
the course, ee aes Ge ane 
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Instructional Materials (Continued) ND SD U D_ #D 
7. included questions which provided valuable feedback on 

how I was doing. A MDs “OS heh 
8, were available for use when needed. ee oe cae ES 
9, contained activities that seemed like needless busy work. ed, BS ads |S 


Which instructional materials were most helpful in this course? 


Which instructional materials were least helpful in this course? 
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ILLINOIS COURSE EVALUATION QUESTIONNAIRE (CEQ) 

Copyright 1972 
Description. The Illinois Course Evaluation Questionnaire (CEQ) was developed 
for use in collecting student attitudes towards a course. Its major purpose 
is to enable faculty members to collect evaluative information about their 
teaching. Form 73 of the CEQ (see next page) contains 23 items which may be 
scored on the following five subscales: General Course Attitude, Course 
Content, Method of Instruction, Interest and Attention of the Students, and 
the Instructor. The 46 optional item response section I and the 16 optional 
item section II allow instructors and departments to include questions that 
can provide more detailed diagnostic feedback. 
Availability. The CEQ is available, upon request, under the following service 
policy which includes: 

1. Supplying forms and directions for administration at a cost of 18¢ 
per student tested plus postage. Optional item sections cost 6¢ 
each. 

2. Scoring, punching cards, and producing two copies of the results. 


3. Sending a maximum of one user's manual with a minimum order of 100 
forms; additional manuals are available for 50¢ each. 


4, Producing summary results across department or college on the CEQ 
items and subscales (optional). 


Address orders or requests for additional information to: 


Office of Instructional Resources 
Measurement and Research Division 
307 Engineering Hall 

University of Illinois 

Urbana, Illinois 61801 


Phone: 217-333-3490 


‘ ILLINOIS COURSE EVALUATION QUESTIONNAIRE CEQ 


ision, Office of Instructional Resources © The Board of Trustees of The University of Illinois, 1972 
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| would take another course that was taught this way. 


The instructor seemed to be interested in students as persons. 


You | 


| would have preferred another method of teaching in this course. 
= = Tr a | 


It was easy to remain attentive. 


z-omwo 


™ 
oe 


The instructor did NOT synthesize, integrate or summarize effectively. 


DC 30-546D 


NOT much was gained by taking this course. 


ci | MT ecm 


The instructor encouraged the development of new viewpoints and appreciations. 


aas-s ee | 


| learn more when other teaching methods are used. 


rPrPr2zo=-at0 


w OF ow ww is & th 
a oT ka th = Oo wo 


The course material seemed worthwhile. 
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> 
oO 
: 
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The instructor was excellent. 


Ya 
>? 
o 
m 
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ee ee ll 


SA A D SD The instructor demonstrated a thorough knowledge of the subject matter. 


zma- 


| would rather NOT take another course from this instructor. 


It was a very worthwhile course. 


Some things were NOT explained very well. 


The course material was too difficult. 


zo-A Ome 


& 0 sD This was one of my poorest courses. 


D SD The instructor seemed to consider teaching as a chore or routine activity. 


D SD It was quite interesting. 


D sp | think that the course was taught quite well. 


The course content was excellent. 


Some days | was NOT very interested in this course. 


It was quite boring. 
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PLEASE FILL OUT THE OTHER SIDE 


| C E Q 


PLEASE USE THIS SIDE OF THE FORM FOR YOUR PERSONAL COMMENTS ON TEACHER EFFECTIVENESS AND GENERAL COURSE VAL{ 
THEN TURN IT OVER AND ANSWER THE OBJECTIVE QUESTIONS ON THE OTHER SIDE, USING PENCIL ONLY, YOUR INSTRUCTO 7 
WILL NOT SEE YOUR COMPLETED EVALUATION UNTIL AFTER FINAL GRADES ARE IN FOR YOUR COURSE. 


COURSE CONTENT 
PLEASE GIVE YOUR COMMENTS ON THE COURSE CONTENT, SUBJECT MATTER,AND ANY PARTICULAR RELEVANCE THIS COURSE HAS 
HAD TO YOUR AREA OF STUDY. 


INSTRUCTORS 
WRITE THE NAME OF YOUR PRINCIPAL INSTRUCTOR Tes 
WHAT ARE YOUR GENERAL COMMENTS ABOUT THE INSTRUCTOR( Ss) IN THIS COURSE? 


INSTRUCT |ONAL OBJECTIVES 
WERE THE INSTRUCTIONAL OBJECTIVES CLEARLY STATED FOR THIS CouRSE? YES No COMMENT: 


PAPERS AND HOMEWORK ; 
COMMENT ON THE VALUE OF BOOKS, HOMEWORK, AND PAPERS (IF ANY) IN THIS COURSE. 


EXAMS . 
COMMENT ON THE EXAMS (QUIZZES, PRACTICALS) AS TO DIFFICULTY, FAIRNESS, ETC. 


GENERAL { 
1. WHAT IMPROVEMENTS IN THIS COURSE WOULD YOU SUGGEST? 


2. PLEASE GIVE YOUR THOUGHTFUL EVALUATION OF TH!IS COURSE WITH COMMENTS, ARE YOU SATISFIED WITH WHAT YOU 
GOT OUT OF THIS COURSE? DO YOU CONSIDER IT A VALUABLE EDUCATIONAL EXPERIENCE? SIMPLY A MEANS OF PASSINI 
A REQUIREMENT? OR A DISAPPOINTMENT? PLEASE COMMENT, 


PLEASE FILL OUT THE OTHER SIDE 


U F 31-153 OPTICAL SCANMING FORMS +4, OPTICAL SCANNING CORPORATION  «cwrow~ 
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Student 
Instructor 
Administrator 


INDIVIDUALIZED INSTRUCTION ATTITUDE SCALE 
Course Date 
DIRECTIONS: The following statements refer to opinions regarding individ- 
ualized instruction. Please circle a number from 1 to 5 indicating the extent 
to which you agree or disagree with each statement. Think of your reactions 


to individualized instruction in general. 


Strongly Disagree Disagree Unsure Agree Strongly Agree 
2 3 4 5 


A. As compared to classes using traditional instructional approaches, stu- 
dents in individualized classes: ; 


1. learn more. Ie P20 3) pad 
2. engage in activities more likely to be meaningful to 

them. SUR IS 2 aa as 
3. are more likely to profit from mistakes. li 2. Yaa es 
4. have more opportunities to experience success. ne?) Aa Nie aa 
5. are more highly motivated to learn. ay She en wa 


B. As compared to traditional instruction, individualized 
instruction: 


1. is less likely to provide the common body of knowledge 
all students need to possess. 2a TAS iS 


2. allows students more choice in what they learn. D2 3 a? 5 


3. emphasizes the processes of learning at the expense 
of subject matter. Ih) 02) OME ey 5 


4. tends to lower educational standards for most students. 1 2 3 4 5 


5. is not an appropriate technique to use for a wide 
variety of subjects. ZS BS BS 


6. places too much responsibility on students. ees enh 5 


126 


FACULTY ASSESSMENT DEVICES 


INDIVIDUALIZED INSTRUCTION INVENTORY 


Course Date 


DIRECTIONS: 


iT, 


Read each of the items below and circle the number at the right 


which best represents the degree to which the statement applies to your 
instructional program. 


Seldom Applies Applies About Applies Most 
Half the Time of the Time 
1 2 3 4 5 
1. Students find and correct their own mistakes. L235 0 
2. Students to determine the reasons for their errors. Dh eS. eh Ree 
3. Students have opportunities to check their own work. 2) Ss he 
4. Different objectives are established for each student on 
the basis of individual interests, abilities, and/or, goals. 1 2 3 4 5 
5. Students, with the help of their instructors, select their 
own topics for study (what they want to learn) within the 
context of the course. He ees ee 
6. Each student decides upon the learning activity he will 
use in order to accomplish his objective. dd) 3) A ee 
7. Students select instructional materials and media that 
appeal to them from the available supply of learning 
resources. fe OS a ee RS. 
8. Each student, alone or with his instructor, decides 
upon the competency level he should reach. a Me VS aeeEE, 
9. Each student progresses through the course of instruc- 
tion independently of other class members. P5218), 48 5 
10. Students are permitted to enter the course of instruc- 
tion at designated times during the quarter. 12 ene OS 
11. Students are permitted to complete the course requirements 
at any time during the quarter. alee Poe ele 
12. Students work at their own rate. LZ ya = 
13. Diagnostic information is obtained by closely observing 
and analyzing student work. Dy Lee or Ae, 
14. Before suggesting any change of activity, diagnostic 
attention is given to the particular student and his 
level of performance. Ds Opes es 


15. 


16. 


17. 


18. 


TIE 


20. 


21. 


22. 


23. 


24. 


25% 


The learning activity for each student to use in 
accomplishing his objective is prescribed or approved by 
the instructor. 


Students are evaluated on their performance in relation 
to the stated objective. 


Students are evaluated according to established 
standards of performance. 


Intra-class groupings are formed to serve a variety of 
instructional purposes. 


Intra-class groupings are changed frequently. 


Information obtained from pretests is used for placing 
students in the proper sequence of learning activities. 


Information obtained from previous school records is used 
for placing students in the proper sequence of learning 
activities. . 


Information obtained from interviews with students is 
used for placing students in the proper sequence of 
learning activities. 


Objectives are written to include the desired student 
behavior, the conditions under which the behavior is 
shown, and the accepted standard of performance. 


Teacher-made materials such as work sheets, games, 
transparencies, and charts are used by students. 


At their convenience, students are able to use audio- 
visual equipment, such as records and record players; 
tape recordings and tape recorders; film strips, slides, 
35 mm films, and projection equipment. 
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INDIVIDUALIZED INSTRUCTION ATTITUDE SCALE 


Course Date 


DIRECTIONS: The following statements refer to opinions regarding individ- 
ualized instruction. Please circle a number from 1 to 5 indicating the extent 
to which you agree or disagree with each statement. Think of your reactions 
to individualized instruction in general. 


Strongly Disagree Disagree Unsure Agree Strongly Agree 
2 3 4 


A. As compared to classes using traditional instructional approaches, stu- 
dents in individualized classes: 


1. learn more _ et SaaS 
2. engage in activities more likely to be meaningful to 

them Hee 8 as 
3. are more likely to profit from mistakes 2 3S A SS 
4. have more opportunities to experience success Pog 36 eS 
5. are more highly motivated to learn ee ata atk PSS 


B. As compared to traditional instruction, individualized 
instruction: 


1. is less likely to provide the common body of knowledge 
all students need to possess Tea sh Wa SS 


2. allows students more choice in what they learn ya 3 4 5 


3. emphasizes the processes of learning at the expense 
of subject matter EO Bo 24 3S 


4. tends to lower educational standards for most students 1 2 3 4 5 


5. is not an appropriate technique to use for a wide 
variety of subjects Lodi ae SS 


6. places too much responsibility on students eS eS 
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ASSESSMENT OF INDIVIDUALIZED INSTRUCTIONAL MATERIALS 


DIRECTIONS: For each item, circle the number in the rating column which best 
describes the quality level according to the following key: 


1. Strongly Disagree 
2. Disagree 

3. Uncertain 

4. Agree 

5. Strongly Agree 


Objectives 


1. Appropriate for my class 
2. Represent different levels of cognitive domain 
3. Important for student to learn 


Basic Concept 


1. Important enough to warrant student's time 
2. Clearly defined 

3. Logically broken into component parts 

4. Appropriate for my class 

Activities 


1. Relate to objectives and basic concepts (no irrelevant 
activities) eh eS nee 


2. Provide practice for behavior(s) indicated in the 


objective 3 eRe pies ae 
3. Clearly stated 1) oe 3 4S 
4, Appropriate for the group (developmental and intellectual 

level) 1 2 364-3 
5. Include a variety from which a student may choose 1 eo Se cee 25 
6. Possible within classroom facilities 42 Ses SS 
7. Include group as well as individual experiences de 2a oe cee a 


8. Provide cpportunity for something in addition to reading : 
and writing answers 2S GS 5 


Resource Materials 
1. Current and up-to-date 


2. Available within reasonable cost limits and difficulty 
in attaining 


3. Include real objects to see and/or use 

4. Include a variety of materials 

5. Reading level appropriate for student 

Evaluation 

1. Pre-test - represents all objectives 
measures at level of objectives 


can be used for assessment in determination 
of activities 


includes scoring key 
2. Self evaluation devices are included in student material 
3. Post-test - represents all objectives 

measures at level of objectives 

different from pre-test 


includes scoring key 
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E32 


ADMINISTRATOR ASSESSMENT DEVICES 
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INDIVIDUALIZED INSTRUCTION ATTITUDE SCALE 
Course Date 
DIRECTIONS: The following statements refer to opinions regarding individ- 
ualized instruction. Please circle a number from 1 to 5 indicating the extent 
to which you agree or disagree with each statement. Think of your reactions 


to individualized instruction in general. 


Strongly Disagree Disagree Unsure Agree Strongly Agree 
2 3 4 5 


A. As compared to classes using traditional instructional approaches, stu- 
dents in individualized classes: 


1. learn more I ee 3) ee ee) 


2, engage in activities more likely to be meaningful 


to them a Aes fate: a 
3. are more likely to profit from mistakes Eo 2 Se 
4. have more opportunities to experience success Ta 2 ir ps8 Path ORS 
5. are more highly motivated to learn 2 Oy 8 vein (8 


B. As compared to traditional instruction, individualized 
instruction: 


1. is less likely to provide the common body of knowledge 
all students need to possess 2 Mareen) 


2. allows students more choice in what they learn I DS ean 


3. emphasizes the processes of learning at the expense 
of subject matter 2s 3) 45 


4. tends to lower educational standards for most students 1 2 3 4 5 


5. is not an appropriate technique to use for a wide 
variety of subjects et reat ji) pec“ aaa) 


6. places too much responsibility on students CD Paks eh Sy 
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COST-BENEFIT ANALYSIS 


The cost-benefit analysis compares program costs to quantitative program 
outcomes and benefits. It is a way of justifying the money expended by the 
benefits received. 

Requests for further information regarding the use and cost of this 


evaluation procedure should be directed to the address given below. 


Meyer, Crawford, and Klaurens. Coordination in Cooperative 
Vocational Education. 
Charles E. Merrill Publishing Company 
Columbus, Ohio 
Copyright, 1975 


135 
COST-BENEFIT ANALYSIS 
Title of Program 
Time Period from to 


COST FACTORS PROJECT COST ANNUAL COST 


Total Program Cost 

Total Outside Funding 

Net Program Cost (Local Funds) 
Net Cost Per Student Enrolled 
Net Cost Per Student Placed 
Average: Annual. Cost. Per Student 


Enrolled in Other Programs in 
the. School 


OUTCOME FACTORS PROJECTED GOALS ACTUAL OUTCOMES 
(Numbers) (Numbers) 


Student Enrollment 


Students Placed in Jobs 
(6Mos. after Completion) 


Students Earning Over 
$500 per Month 


Students Rated Above Average 
by Employers 


Students Who Rated the Program 
"Highly Beneficial" 


Students Who are ''Very 
Satisfied" in Present Job 


Parents Who Rated the Program 
as "Very Beneficial" 


(Other Factors Taken from 
Program Goals) } 
ee 
In Meyer, Warren G., Crawford, Lucy, and Klaurens, Mary K. Coordination in 
Cooperative Vocational Education. Columbus, Ohio: Charles E. Merrill 
Publishing Company, Copyright 1975. 
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EMPLOYER ASSESSMENT DEVICES 
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EMPLOYEE PERFORMANCE 


NOTE: Tasks to be included on this form should be those identified via a 
task analysis for your particular occupational area. If this has not been 
done, such an analysis would be appropriate. 


DIRECTIONS: This rating scale is designed for use by employers as they assess 
the amount of skill actually demonstrated by the employee on the job. Please 
rate the employee's performance for the tasks identified below according to 
amount of skill demonstrated as follows: 


L - Limited Skill - Supervision is required 

M - Moderate Skill - Minimum supervision required 

S - Skilled - Works independently 
EXAMPLES: 
1. Hangs doors, using butt hinges. L Ms 
2. Reads a thermometer accurately. L) Me ss 
3. Types 50 words per minute accurately. Low ¥S 


4, Measures using architect's mechanical, engineer's 
and civil engineer's scales. uM. Ss 


5. Sews welts into cushion border. i M Ss 
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EMPLOYMENT CHECKLIST 
DIRECTIONS: Please check the item that relates to the employment status of 
the employee identified below. 
Employee Date Job 


The employee: 


1. Is currently employed in this firm Yes 
No (complete 2 or 3) 


If currently employed, the employee's performance is 

above average 
average 
below average 

2. If the employee has been discharged, please indicate the reason(s). 
Job performance was below standard. Insubordination. 
Could not work with others. Job was terminated. 
Was not dependable, 


Other (please specify) 


3. Has resigned. 
If the employee has resigned, please indicate the reason(s). 
Lack of job satisfaction. Insufficient wages. 
Changed occupations. Moved. | 
Not known. 


Other (please specify) 
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ASSESSMENT OF EMPLOYEE TRAITS 

Will you please complete the following and return within 5 days? 
Report on Date 
Please check the statements under each item that would best describe the student. 
Attitude Toward Criticism 

Asks for constructive criticism 

Accepts criticism, profits by suggestions 


Accepts criticism, does nothing about it 
Resents criticism 


| 


Attitude Toward Work 

Positive approach, wants to succeed 

Enjoys work and shows promise 

"T don't care" attitude prevails at times 
Negative approach, appears bored with the job 


Cooperation 

Cooperates willingly at all times 

Usually cooperates with others 

Often indicates resentment toward cooperating with others 
Unwilling to cooperate with others 


Courtesy 

Always considerate and courteous 

Usually is considerate and polite 

Polite to customer but inconsiderate of fellow workers 
Inconsiderate of others, rude to others 


Hi 
5 
a 
ct 
He 
ist) 
cr 
ra 
< 
o 


Energetic, capable and willing to go beyond mere assigned duties 
Performs routine work accurately 

Needs occasional prodding to complete routine 

Fails to complete expected work 


Knowledge of Job 

Understands the job thoroughly 

Is interested and desires to learn more about job 

Listens to instructions but does not seem to understand 
Has little understanding of the job, does not try to learn 


Performance on Job 

Performs duties with high degree of accuracy 

Usually performs skillfully and with relative ease 

Listens to instructions but fails to follow through 

Extremely careless and inaccurate in job performance ~ 
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Personal Appearance 

Attractive, neat, and appropriately groomed at all times 
Usually is neat and attractive 

Frequently neglects personal appearance 

Must improve personal appearance to maintain the job 


| 


Realiability 

Can always be depended upon and extremely conscientious 
Can usually be depended upon, conscientious 

Completes job but requires close supervision 
Unreliable 


| 


Work 
Efficient, manages time and energy well 
Industrious but not always efficient 
Frequently wastes time and energy 

Fails to manage time and energy well, lazy 


ILE 


Additional comments: 


Signature 
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MINNESOTA SATISFACTORINESS SCALES 
Copyright 1965 

Description. The Minnesota Satisfactoriness Scales (MSS) are designed to 
measure an employee's satisfactoriness on a job. The MSS is usually completed 
by the employee's supervisor who evaluates the employee on 28 items concerning 
the employee's behavior on the job. The MSS provides scores on five scales: 
Performance, Conformance, Dependability, Personal Adjustment and General 
Satisfactoriness. 
Availability. Requests for purchase of the MSS should include a description 
of the qualifications of the prospective user. The MSS is available for use 
only under the supervision of qualified psychologists. 
Copies are available at the following prices (minimum order is 30 copies): 

30f 0" #990 Copsese aii.) Pere ust eel ea hereieiet olan! Lac edah 
500) ‘ar more: Copies. (sa at 6 14 eee let see 2 os) LAC each 


All postage is additional. Shipment is made by fourth-class mail unless 


otherwise specified. Prices are subject to change without notice. 


Address orders to: 


Vocational Psychology Research 
Elliott Hall 

University of Minnesota 
Minneapolis, Minnesota 55455 


Phone: 611-376-7377 
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DATA SUMMARIZATION FORMS 


BBL Bt hes a 


DIRECTIONS: 


I. 


En. 
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PROFILE FOR ATTITUDES TOWARD INDIVIDUALIZED INSTRUCTION 


To analyze the ratings on the Individualized Instruction Attitude 
Scale, transfer the numerical rating for each item to the corre- 
sponding blank below. Add the ratings for each factor. Enter 
these totals beside the numerals to the right. These totals can 
then be compared to the criteria levels previously established 

in task 2.4 in the model. Possible total scores for each factor 
are shown in parentheses. 


Outcomes (25) 
BL, «~Gonmonebodysot eknowlledSeuwen « « . & «= « « 
BS... “Processes O£ vllearning secs 614 6s se 


B4. «Lower educational standards . «1... +. + 


B5. Not 


for wide variety of subjects .... 


Bo. loo much responsiibsJaity adn hs feibawee ne © ils 


Effect upon Students (30) 


Bde. LCR PDO MOLE ee) ek a ee a eae Cera fe ee 
A2, Activities more meaningful . .. 1. «+ «©» 
AS. PrOtit Exom mistaueg, cle.a See ee lee ee 
AGG, EXPerlence, SUCCES utes) aie) is 6 us) @ << 


AS. Highivemotivated toeltearmy Fal «6 « «les 


B2e “Aldiows: More i@hol@e: ga. eels @ 6 « # Je2 li ae Bes 
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III. 2. PROFILE FOR INDIVIDUALIZATION 
DIRECTIONS: To analyze the ratings on the Individualized Instruction 
Inventory, transfer the numerical rating for each item to the 
corresponding blank below. Add the ratings for each factor. 
Enter these totals beside the numerals to the right. These 
totals can then be compared to the criteria levels previously 
established in task 2.4 in the model. Possible total scores for 
each factor are shown in parentheses. 
I. Self-Evaluation (15) 
i, Edndeand: coprect’ owntmistakes wl6. « « « « ow « 
2. Determinesreasons for errors "Gr wekl ee. . se 
So. (Check ‘owmiwork. “f= 14, 6 (sacl We) eh een se a Si os Es 
II. Student Involvement in Decision Making (25) 
4. Objectives based on individual interests .... 
Da. Selectiownetopics for study 2. G.« & = « « » « « 
6. Decides upon learningsactivity "SUles"s . « « « 
7. Select instructional material and media ..... 
8. Decides upon competency level to reach ..... cL. 
III. Flexibility of Pacing (20) 
9. Progresses through course independently ..... 
10. Permitted to enter course at designated time .. 
11. Permitted to complete course at any time .... 
ee WORK ate OWN TALC: % 16. + sem & 5 oe eed x Di. 
IV. Types of Evaluation (25) 


136 Diagnostic information obtained . . . «© « « « «'\% 


14. Diagnostic information gained from student and 
permormance: level. i. 6. ue oy eX ee we ee 


15. Learning activity prescribed or approved by 
PEVGUTMECIEONGE Ue We. te Ge, iS. sagt? “Pushy SR Pe Uebel Ese eo wy a 


Vil. 


VII. 


16. Evaluate performance in relation to objective 


17. Evaluated by established standards of per- 
niOwya(eVet 45 Bi then bg basal “ol = al! “Gh uc omeoe & 


Intra-Class Groupings (10) 
18. Serve variety of instructional purposes . 
HOt, iChanged ‘Erequently <0) saeieee «fess = s 
Information for Placement of Students (15) 
20. Pretests used for placing students .... 


21. Previous school records used for placing 
Students) so.) ss. es, <1 eee SINC fe? a 


22. Interviews with students used for placement 


Materials and Equipment (15) 


23. Objectives include behavior, conditions, and 


PELTLOrMAnCey:;. sss. « « ‘oe seen Te) elre) « 
24. Teacher-made materials used by students. . 


25. Equipment used at students' convenience . . 


LV. 


Vi. 


VII. 
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IV. SUGGESTIONS FOR CRITERIA LEVELS AND 
SUMMARIZATION OF DATA 


Assessment Devices 


Achievement Tests 


Reactions to Course, Instructor, 
and Instructional Materials 


Illinois Course Evaluation 


Individualized Instruction Attitude 
Scale 


Individualized Instruction Inventory 
Assessment of Individualized 
Instructional Materials 

Cost-Benefit Analysis 

Employee Performance 

Assessment of Employee Traits 


Minnesota Satisfactoriness Scale 


Criteria Levels 


Ninety per cent of the students 
reach ninety per cent on all the 


objectives 


*Establish acceptable 
for each section 


Establish acceptable 


*Establish acceptable 
for each factor 


*Establish acceptable 
for each factor 


*Establish acceptable 
and sub-scores 


total scores 


score 


total scores 


total scores 


total scores 


Examine actual cost and outcomes 


Identify strengths and weaknesses 


Identify strengths and weaknesses 


Refer to the users' manual 


*Note - In making a decision about the minimum score, you may wish to consider 
a minimum acceptable level for each item as well as a minimum total 


score. 
on any item. 


For example, ratings of less than '3' may not be acceptable 


